CLAIMS 

1. A process for a immersing a user in a three dimensional virtual reality 
5 environment room, comprising the steps of: 

providing a head mounted display worn by a user; 

wherein said head mounted display comprises a video camera and video 
display; 

providing a plurality of target markers; 
10 distributing said plurality of target markers within said room; 

wherein each of said plurality of target markers are distinct from all other 
target markers in said plurality of target markers and distinct from rotated versions 
of itself; 

receiving a video signal of a portion of said room from said video camera; 
15 identifying at least one target marker in said video signal; 

calculating user position within said room using relative positioning of 
identified target marker(s); 

streaming three dimensional video content to the user through said video 
display; and 

20 dynamically repositioning the user's perspective viewpoint within said three 

dimensional video content by using said calculated user position to adjust position 
and viewing angle within said three dimensional video content. 

2. The process of Claim 1 , further comprising the step of: 

25 providing target marker calibration means for automatically calibrating 

relative positions of said plurality of target markers within said room. 

3. The process of Claim 2, wherein said target marker calibration means 
detects said plurality of target markers in said room using said video signal, and 

30 wherein said target marker calibration means identifies pairs of target markers 
within said room. 



63 



4. The process of Claim 3, wherein said target marker calibration means 
determines positioning of each target in a target pair relative to said video camera, 
wherein said target marker calibration means calculates positioning of each target 
in a target pair relative to each other, and wherein said target marker calibration 

5 means stores the relative positioning of the target pair in a list of relative target 
transforms. 

5. The process of Claim 4, wherein said calculating user position step 
determines the relative positioning of identified target markers using said relative 

1 0 target transforms. 

6. The process of Claim 5, wherein said calculating user position step detects 
the effects of viewing angles and gives higher weight to target markers that are 
detected at more reliable angles. 

15 

7. The process of Claim 1, wherein said receiving step receives said video 
signal via a wireless link. 

8. The process of Claim 1, wherein said streaming step streams said three 
20 dimensional video content to the user through said video display via a wireless link. 

9. The process of Claim 1, wherein said streaming step overlays said three 
dimensional video content onto said video signal and sends a resulting combined 
signal to said video display. 

25 

10. The process of Claim 1, wherein said plurality of target markers are a 
sufficient number such that at least one target marker is always visible in said video 
signal. 

30 11. An apparatus for a immersing a user in a three dimensional virtual reality 
environment room, comprising: 

a head mounted display worn by a user; 
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wherein said head mounted display comprises a video camera and video 
display; 

a plurality of target markers; 

means for distributing said plurality of target markers within said room; 
5 wherein each of said plurality of target markers are distinct from all other 

target markers in said plurality of target markers and distinct from rotated versions 
of itself; 

a module for receiving a video signal of a portion of said room from said 
video camera; 

10 a module for identifying at least one target marker in said video signal; 

a module for calculating user position within said room using relative 
positioning of identified target marker(s); 

a module for streaming three dimensional video content to the user through 
said video display; and 
15 a module for dynamically repositioning the user's perspective viewpoint 

within said three dimensional video content by using said calculated user position 
to adjust position and viewing angle within said three dimensional video content. 

12. The apparatus of Claim 11, further comprising: 

20 target marker calibration means for automatically calibrating relative 

positions of said plurality of target markers within said room. 

13. The apparatus of Claim 12, wherein said target marker calibration means 
detects said plurality of target markers in said room using said video signal, and 

25 wherein said target marker calibration means identifies pairs of target markers 
within said room. 

14. The apparatus of Claim 13, wherein said target marker calibration means 
determines positioning of each target in a target pair relative to said video camera, 

30 wherein said target marker calibration means calculates positioning of each target 
in a target pair relative to each other, and wherein said target marker calibration 
means stores the relative positioning of the target pair in a list of relative target 
transforms. 
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15. The apparatus of Claim 14, wherein said calculating user position module 
determines the relative positioning of identified target markers using said relative 
target transforms. 

5 

16. The apparatus of Claim 15, wherein said calculating user position module 
detects the effects of viewing angles and gives higher weight to target markers that 
are detected at more reliable angles. 

10 17. The apparatus of Claim 11, wherein said receiving module receives said 
video signal via a wireless link. 

18. The apparatus of Claim 11, wherein said streaming module streams said 
three dimensional video content to the user through said video display via a 

15 wireless link. 

19. The apparatus of Claim 11, wherein said streaming module overlays said 
three dimensional video content onto said video signal and sends a resulting 
combined signal to said video display. 

20 

20. The apparatus of Claim 11, wherein said plurality of target markers are a 
sufficient number such that at least one target marker is always visible in said video 
signal. 

25 21. A process for tracking a video camera in a three dimensional virtual reality 
environment room, comprising the steps of: 

providing a video camera movable within said room; 
providing a plurality of target markers; 
distributing said plurality of target markers within said room; 
30 wherein each of said plurality of target markers are distinct from all other 

target markers in said plurality of target markers and distinct from rotated versions 
of itself; 

receiving a video signal of a portion of said room from said video camera; 
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identifying at least one target marker in said video signal; and 
calculating video camera position within said room using relative positioning 
of identified target marker(s). 

5 22. The process of Claim 21 , further comprising the step of: 

providing target marker calibration means for automatically calibrating 
relative positions of said plurality of target markers within said room. 

23. The process of Claim 22, wherein said target marker calibration means 
10 detects said plurality of target markers in said room using said video signal, and 

wherein said target marker calibration means identifies pairs of target markers 
within said room. 

24. The process of Claim 23, wherein said target marker calibration means 
15 determines positioning of each target in a target pair relative to said video camera, 

wherein said target marker calibration means calculates positioning of each target 
in a target pair relative to each other, and wherein said target marker calibration 
means stores the relative positioning of the target pair in a list of relative target 
transforms. 

20 

25. The process of Claim 24, wherein said calculating video camera position 
step determines the relative positioning of identified target markers using said 
relative target transforms. 

25 26. The process of Claim 25, wherein said calculating video camera position 
step detects the effects of viewing angles and gives higher weight to target markers 
that are detected at more reliable angles. 

27. The process of Claim 21, wherein said receiving step receives said video 
30 signal via a wireless link. 
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28. The process of Claim 21, wherein said plurality of target markers are a 
sufficient number such that at least one target marker is always visible in said video 
signal. 

29. An apparatus for tracking a video camera in a three dimensional virtual 
reality environment room, comprising: 

a video camera movable within said room; 
a plurality of target markers; 

means for distributing said plurality of target markers within said room; 
wherein each of said plurality of target markers are distinct from all other 
target markers in said plurality of target markers and distinct from rotated versions 
of itself; 

a module for receiving a video signal of a portion of said room from said 
video camera; and 

a module for identifying at least one target marker in said video signal; 
a module for calculating video camera position within said room using 
relative positioning of identified target marker(s). 

30. The apparatus of Claim 29, further comprising: 

20 target marker calibration means for automatically calibrating relative 

positions of said plurality of target markers within said room. 

31. The apparatus of Claim 30, wherein said target marker calibration means 
detects said plurality of target markers in said room using said video signal, and 

25 wherein said target marker calibration means identifies pairs of target markers 
within said room. 

32. The apparatus of Claim 31, wherein said target marker calibration means 
determines positioning of each target in a target pair relative to said video camera, 

30 wherein said target marker calibration means calculates positioning of each target 
in a target pair relative to each other, and wherein said target marker calibration 
means stores the relative positioning of the target pair in a list of relative target 
transforms. 
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33. The apparatus of Claim 32, wherein said calculating video camera position 
module determines the relative positioning of identified target markers using said 
relative target transforms. 

5 

34. The apparatus of Claim 33, wherein said calculating video camera position 
module detects the effects of viewing angles and gives higher weight to target 
markers that are detected at more reliable angles. 

10 35. The apparatus of Claim 29, wherein said receiving module receives said 
video signal via a wireless link. 

36. The apparatus of Claim 29, wherein said plurality of target markers are a 
sufficient number such that at least one target marker is always visible in said video 
15 signal. 
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